On a Connection between Entropy, Extensive Measurement and Memoryless Characterization

نویسنده

  • Peter Sunehag
چکیده

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is applied to the measurements. A link function can also be used to define an alternative structure on a set. We will see that generalized entropies are equivalent to using a different scale for the phenomenon that is studied compared to the scale the measurements arrive on. An extensive measurement scale is here a scale for which measurements fulfill a memoryless property. We conclude that the alternative algebraic structure defined by the link function must be used if we continue to work on the original scale. We derive Tsallis entropy by using a generalized log-logistic governing distribution. Typical applications of Tsallis entropy are related to phenomena with power-law behaviour.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On Channel Capacity, Uncoded Error Probability, ML-Detection and Spin Glasses

* denoting the binary entropy function and denoting the uncoded error probability. The goal of this paper is to extend such relationship to channels where the connection between uncoded error probability and channel capacity is less obvious. A first step into that direction is the following lemma proven in [1]: Lemma 1: Consider a memoryless weakly symmetric1 channel with binary input and outpu...

متن کامل

Measurement and Representation of the ADC Integral Nonlinearity in the Time Domain

In this paper a new approach to the measurement and compensation of the soft components of the integral nonlinearity (INL) of the ADC in the time domain is presented, using both sine and triangular waves. Connection will be established between the user oriented nonlinear description based on memoryless nonlinear models using orthogonal polynomial series and the manufacturer oriented specificati...

متن کامل

Investigation of the Slipping Wear based on the Rate of Entropy Generation

Wear is a complicated phenomenon caused by the relative movement of two contacting surfaces compressed together by a normal force. Prediction of the wear, in most cases, requires various experiments and microstructural characterization of the contacting surfaces. Mathematical models based on physical concepts could provide considerable help in understanding the physical behavior and hence the p...

متن کامل

Investigation of the Slipping Wear based on the Rate of Entropy Generation

Wear is a complicated phenomenon caused by the relative movement of two contacting surfaces compressed together by a normal force. Prediction of the wear, in most cases, requires various experiments and microstructural characterization of the contacting surfaces. Mathematical models based on physical concepts could provide considerable help in understanding the physical behavior and hence the p...

متن کامل

A Note on the Bivariate Maximum Entropy Modeling

Let X=(X1 ,X2 ) be a continuous random vector. Under the assumption that the marginal distributions of X1 and X2 are given, we develop models for vector X when there is partial information about the dependence structure between X1  and X2. The models which are obtained based on well-known Principle of Maximum Entropy are called the maximum entropy (ME) mo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008